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Abstract. We present a precise determination of the 
apparent magnitude of the tip of the red giant branch 
(TRGB) in the I (0.8/xm), J (1.25/xm), and K s (2.15/zrrx) 
bands from the luminosity function of a sample of data ex- 
tracted from the DENIS catalogue towards the Magellanic 
Clouds (Cioni et al. 2000a). From the J and Ks magni- 
tudes we derive bolometric magnitudes rriM. We present 
a new algorithm for the determination of the TRGB mag- 
nitude, which we describe in detail and test extensively 
using Monte-Carlo simulations. We note that any method 
that searches for a peak in the first derivative (used by 
most authors) or the second derivative (used by us) of 
the observed luminosity function does not yield an un- 
biased estimate for the actual magnitude of the TRGB 
discontinuity. We stress the importance of correcting for 
this bias, which is not generally done. We combine the 
results of our algorithm with theoretical predictions to 
derive the distance modulus of the Magellanic Clouds. 
We obtain m - M = 18.55 ± 0.04 (formal) ±0.08 (sys- 
tematic) for the Large Magellanic Cloud (LMC), and 
m - M = 18.99 ± 0.03 (formal) ±0.08 (systematic) for 
the Small Magellanic Cloud (SMC). These are among the 
most accurate determinations of these quantities currently 
available, which is a direct consequence of the large size 
of our sample and the insensitivity of near infrared obser- 
vations to dust extinction. 
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1. Introduction 

In the evolution of stars the position of the tip of the red 
giant branch (TRGB) marks the starting point of helium 
burning in the core. It is one of the strongest characteris- 
tics of the life of stars seen in theoretical models, together 
with the main sequence turn-off point, the red giant and 
the asymptotic giant clump. It has been used successfully 



for several decades (Sandage |1971 ) to estimate the dis- 
tance of resolved galaxies (e.g., Lee, Freedman & Madore 
p.993|) . The TRGB magnitude depends only very weakly 
on age and metallicity, and yields comparable precision 
as classical distance indicators such as Cepheids and RR- 
Lyra variables. 

Cioni ct al. ( |2000aD prepared the DENIS Catalogue 
towards the Magellanic Clouds (DCMC), as part of the 
Deep Near Infrared Southern Sky Survey performed with 
the lm ESO telescope (Epchtein et al. 1997). The cata- 



logue contains about 1 300 000 and 300 000 sources toward 
the LMC and the SMC, respectively; 70% of them are real 
members of the Clouds and consist mainly of red giant 
branch (RGB) stars and asymptotic giant branch (AGB) 
stars, and 30% are galactic foreground objects. This is a 
very large and homogeneous statistical sample that allows 
a highly accurate determination of the TRGB magnitude 
at the corresponding wavelengths. Among other things, 
this yields an important new determination of the distance 
modulus of the LMC. This distance modulus is one of the 
main stepping stones in the cosmological distance ladder, 
yet has remained some what uncertain and controversial 
(e 



2000) 
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;., Mould et al. 
Section 2 describes how the data were selected from 
the DCMC catalogue to avoid crowding effects, and how 
we have calculated bolometric corrections. Section 3 dis- 
cusses the luminosity function (LF) and the subtraction of 
the foreground component. Section 4 discusses the TRGB 
determination and gives comparisons with previous mea- 
surements. Section 5 discusses the implications for the dis- 
tances to the Magellanic Clouds. Concluding remarks are 
given in Section 6. The Appendix provides a detailed de- 
scription of the new method that we have used to quantify 
the TRGB magnitude, as well a discussion of the formal 
and systematic errors in the analysis. 

2. The Sample 

2.1. The Data 

The DCMC covers a surface area of 19.87 x 16 square 
degrees centered on (a, 8) = (5^27 m 20 s ,-69 o 00'00") to- 
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ward the LMC and 14.7 x 10 square degrees centered on 
(a, S) = (l' l 02 m 40 s ,-73°00'00") toward the SMC (J2000 
coordinates). We extracted all the sources detected simul- 
taneously in the three DENIS photometric wave bands: 
I (0.8/im), J (1.25pm) and K s (2.15/zm). We excluded 
sources that were detected in all three wave bands but 
at different times (this can happen because DENIS strips 
overlap). The selection of sources that are present in all 
three wave bands strongly reduces possible crowding ef- 
fects that affect mostly the I band. We removed sources 
affected, even slightly, by image defects (null image flag) 
and sources with bright neighbours or bad pixels, sources 
that were originally blended, or sources with at least one 
saturated pixel (null extraction flag). This increases the 
level of confidence on the resulting sample. The main final 
sample for the present analysis contains 33 117 sources to- 
ward the SMC and 118 234 sources toward the LMC. This 
constitutes about 10% of all the sources listed for each 
Cloud in the DCMC. 

To estimate the contribution of the foreground com- 
ponent we also considered the data in offset fields outside 
the spatial limits of the DCMCQ, covering the same range 
in right ascension and from a maximum of 5 = — 57° to 
a minimum of 8 = —87° (the full declination range of a 
DENIS strip). These data were reduced together and the 
same selection criteria, on the basis of the detection wave 
bands and the flags, were applied as to the data constitut- 
ing the DCMC. The total sample (DCMC plus extension 
in declination) contains 92 162 and 184129 sources in the 
RA ranges for the SMC and the LMC, respectively. 

The distribution of the formal photometric errors in 
each wave band is shown in Fig. [l]. At the brighter magni- 
tudes (those of interest for the TRGB determination) , the 
random errors in the sample are not dominated by the 
formal photometric errors, but by random errors in the 
photometric zero-points for the individual strips. The dis- 
persions (lcr) of these zero-point variations are 0.07 mag 
in the / band, 0.13 mag in the J band and 0.16 mag in 
the Ks band. Note that the formal error with which the 
TRGB magnitude can be determined is not limited to the 
size of these zero-point variations, but instead can be quite 
small (the formal error is proportional to l/ViV", where N 
is the number of stars in the sample) . 

The /, J and Ks magnitudes in the present paper are 
all in the photometric system associated with the DENIS 
passbands. These magnitudes are not identical to the clas- 
sical Cousins I and CTIO J and K magnitudes, although 
they are close (differences are < 0.1 magnitudes). The fi- 
nal transformation equations for the passbands will not be 
available until the survey is completed, but a preliminary 
analysis is presented by Fouque et al. ( |1999[ ). Note that 
our determinations of the distance moduli for the LMC 
and the SMC (Section 5) are based on bolometric magni- 
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1 These data are not part of the DCMC catalogue but are 
available on request from the first author. 



Fig. 1. Distribution of the photometric errors, (a) / band, 
(b) J band, (c) Ks band, (d) rribol- Black dots are for 
sources toward the LMC and empty dots are for sources 
toward the SMC. Error bars show the dispersion in the 
photometric errors in 0.5 mag bins. 



tudes derived from the data, which are fully corrected for 
the specifics of the DENIS passbands. 

2.2. Bolometric correction 

We have calculated the apparent bolometric magnitude 
(rriboi) for all the sources selected according to the crite- 
ria described in Section 2.1, and with (J — Ks) > 0.4. We 
have chosen to use only the J and Ks bands to derive rriboi 
(see below). Sources with (J— Ks) < 0.4 do not influence 
the position of the TRGB (see Fig. || below), and have 
too low a percentage of flux in the near-infrared (NIR) 
to give a reliable measure of m& z with these criteria. We 
used two different bolometric corrections, depending on 
the (J — Ks) colour. For sources with (J — Ks) < 1.25, 
we simply use a blackbody fit on the {J — Ks) colour; such 
sources are mostly RGB or early AGB (E-AGB) stars in 
our sample. Sources with larger values of (J — Ks) are 
mostly thermally pulsing AGB (TP-AGB) stars, some of 
which are losing mass and are surrounded by a circumstel- 
lar envelope. For them we used the results of individual 
modelling of galactic carbon (C) stars by Groenewegen et 
al. (1999), combined with a series of models of increasing 
dust opacity where the central star has a spectral type 
M5 and the dust grains are composed of silicates (Groe- 
newegen, private communication). 

In both cases, blackbody fit and spectral models, our 
method to infer mboi is different from what is usually per- 
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formed in the literature. We do not make any attempt 
to transform a magnitude, i.e. an integrated flux over the 
passband, into a flux density at a reference wavelength, 
in order to suppress one step which already makes an as- 
sumption on the spectral distribution of the source. We 
only use the integrated flux measured over the J and 
Ks DENIS passbands. Theoretical spectral distributions, 
i.e. blackbodies with temperatures ranging from 10, 000 
to 300 K and the models from Groenewegen and collabo- 
rators, were multiplied with the DENIS passbands (which 
includes a mean atmosphere at la Silla observatory) to de- 
rive the percentage of the total flux which is measured in 
each DENIS passband as a function of the DENIS colours. 
Then, for each selected DCMC source, rriboi is calculated 
by interpolating in the theoretical grids the percentage of 
flux measured in the J and Ks bands from the observed 
(J — Ks) colour. We ha ve use d here the same zero point 
as in Montegri ffo et al. ( 1998 ). More details are provided 
in Loup et al. ( [2000D . 

We have compared our results with the bolometric cor- 
rections BCk inferred by Montegriffo et al. As can be seen 
in their Fig. 3, their bolometric correction is valid only 
for sources with 0.2 < (J — Ks) < 0.7, with a typical 
spread around the fit of 0.1 magnitude. For sources with 
0.4 < ( J — Ks) < 0.5 our blackbody fit agrees with their 
bolometric corrections to within the errors. On the other 
hand, for some sources with (J — Ks) > 0.5, they under- 
estimate rriboi by 0.5 to 2 magnitudes compared to our 
calculations. This is not surprising and can be inferred 
already from their Fig. 3; it does not indicate a short- 
coming in our approach. We also compared our results 
with what one obtains by making blackbody fits using 
both the (/ — J) and (J — Ks) colours. For sources with 
0.4 < (J — Ks) < 1.25 it does not produce any systematic 
effect; there is merely a spread of typically 0.1 magnitude 
between both calculations, consistent with the formal er- 
rors. Inclusion of the / band would produce a systematic 
effect for bluer sources than those selected here, but those 
are not relevant for the TRGB determination. We there- 
fore decided to use only the J and Ks band data in our 
calculations of rriboi, to minimize the effects of the inter- 
stellar reddening which are much more pronounced in the 
/ band than in J and Ks- 

There are both random and systematic errors in our 
estimates of rriboi- The random errors come from two 
sources, namely from the observational uncertainties in 
the observed J and Ks band magnitudes, and from the 
corresponding uncertainties in the (J—Ks) color. We have 
calculated the resulting random errors in the rriboi esti- 
mates through propagation of these errors. There are also 
two sources of systematic error in the rriboi estimates. The 
first one derives from uncertainties in the dust extinction 
correction. Our treatment of dust extinction is discussed in 
Section 2.3; Appendix A. 3. 4 discusses how the uncertain- 
ties in this correction introduce a small systematic error on 
the TRGB magnitude determination. The second source 



of systematic error comes from the difference between the 
real spectral energy distribution of the star and the one 
we assume to estimate rriboi- For blackbody fits, we did 
not make any attempt to estimate this error because we 
lack information for that purpose (we would need spectra 
and/or UBVRIJHKL photometry on a sample of stars). 
For the AGB star models from Groenewegen and collab- 
orators, we can estimate part of this error. The (J — Ks) 
colour does not provide enough information to fully con- 
strain the set of model parameters, i.e. (J — Ks) does not 
give a unique solution, especially when the chemical type 
of the star is unknown. With the models available in this 
work, we have estimated this systematic model error to be 
5% on the interpolated percentage of flux. This is of course 
a lower limit as there can be some objects whose spectral 
energy distribution differs from all the ones produced in 
the models. On the other hand, for most stars near the 
TRGB the blackbody fit is the relevant model, and for 
these the systematic errors could be smaller. In the end 
we have included in our final error budget a systematic 
error of ±0.05 mag in our rriboi estimates due to uncer- 
tainties in the underlying spectral model, but it should be 
noted that this estimate is not very rigorous. 

In our analysis of the TRGB magnitude we have prop- 
agated the random and systematic errors on rriboi sep- 
arately. However, for illustrative purposes we show in 
Fig. [l]d the combined error. The surprising shape of the 
error on mbol as a function of rriboi should not be taken 
as real. It is an artifact coming from the fact that a sys- 
tematic model error was included in the figure only for 
TP-AGB stars. The great majority of the brightest stars 
are TP-AGB stars for which we use AGB models. Going 
towards fainter stars, the (J — Ks) colour decreases and 
we mostly use blackbody fits, for which we have not in- 
cluded a systematic model error in the figure. The error 
on rriboi thus seems to decrease around the TRGB. 



2.3. Dust Extinction 

The contribution of the internal reddening for the Mag- 
ellanic Clouds is on average only E(B — V) = 0.06 while 
the foreground reddening can be very high in the out- 
skirts of the Clouds. We have not attempted to correct 
our sample for extinction on a star by star basis. Instead 
we correct all data for one overall extinction. We adopt 
E(B — V) = 0.15 ± 0.05 as the average of known measure- 



ments (Westerlund 1997) for both Clouds. Adopting the 
extinction law by Glass (1999) for the DENIS pass bands 
[A v :A I :A J : A Ks = 1 : 0.592 : 0.256 : 0.089] and R v = 3.1 
we obtain A/ = 0.27, Aj = 0.11 and A Ks = 0.04. Our 
approach to correct for dust extinction is a simple ap- 
proximation to what is in reality a very complicated issue 



(e.g., Zaritsky 1999). We discuss the effect of uncertainties 



in the dust extinction on our results in Sections 4.4 and 5. 
While this is an important issue in the / band, the bolo- 
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metric magnitudes that we use to determine the distance 
modulus are impacted only at a very low level. 



3. The Luminosity Function 

The luminosity function (LF) of a stellar population is a 
powerful tool to probe evolutionary events and their time 
scales. Major characteristics of a stellar population are 
associated to bumps, discontinuities and slope variations 
in the differential star counts as a function of magnitude. 
However, for a proper interpretation of observed luminos- 
ity functions several important issues should be taken into 
account. These include the completeness of the sample of 
data, the foreground contamination with respect to the 
analyzed population, the photometric accuracy and the 
size of the sampling bins. The total number of objects 
involved plays an important role to make the statistics 
significant. 

In most previous studies of the luminosity functions 
of stellar populations in clusters or galaxies, in either the 
optical or the NIR, limited statistics have been the main 
(Cioni et 



problem. The DENIS ( Cioni et al. |2000a| ) and 2MASS 
(Nikolaev & Weinberg |2000 ) samples provide the first 
truly large statistical sample in the NIR of the Magellanic 
Cloud system. This wavelength domain is the most suit- 
able to study late evolutionary stages such as the RGB and 
the AGB. In the present paper we restrict the discussion 
of the luminosity function mostly to the TRGB; a more 
general discussion is given elsewhere (Cioni, Messineo & 
Habing 2000). 
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Fig. 2. Distribution of the sources in the sample versus 
declination using bins of 0.1 degrees, for the SMC (left) 
and the LMC (right). 



fields at each right ascension range the data were com- 
bined into one histogram. This offset-field histogram (thin 
dashed curves) was then scaled to fit the corresponding 
LMC or SMC field histogram at bright magnitudes, for 
which almost all the stars belong to the foreground. Sub- 
traction yields the foreground-subtracted magnitude dis- 
tribution for each of the Clouds (heavy solid curves). For 
comparison we also extracted from the catalogue an ex- 
tended sample consisting of those stars detected in the I 
and J bands (irrespective of whether or not they were de- 
tected in Ks). This sample (heavy dashed curves) is com- 
plete to fainter magnitudes than the main sample, and 
therefore illustrates the completeness limit of the main 
sample. 



3. 1 . The contribution of the Galaxy 



3.2. The shape 



For the removal of foreground contamination we consid- 
ered two offset fields around each cloud. The range of right 
ascension (RA) is the same for both the cloud and the off- 
set fields; it is the same of the DCMC catalogue (Section 
2.1). For the LMC the north field has -58° > 6 > -60° 
and the south field has -80° > S > -86°; for the SMC 
the north field has —60° > 6 > —66° and the south field 
has -80° > S > -86°. The LMC region itself was limited 
to the declination range -62° > 6 > -76°, and the SMC 
region to —69° > S > —77°. Fig. || shows the distribu- 
tion versus declination of the sources in the sample, using 
bins of 0.1 degrees. The foreground contribution clearly 
decreases toward more negative declinations, due to the 
difference in Galactic latitude. The difference in number 
between the foreground contribution around the LMC and 
around the SMC is consistent with the fact that the LMC 
is observed closer to the galactic plane than the SMC is. 
The structure of the LMC is clearly wider than the one 
of the SMC and this may contribute to create the strong 
declination trend around the LMC. 

For each field and photometric band we constructed a 
histogram of the observed magnitudes (thin solid curves 
in the N(m) panels of Fig. ||). For the two different offset 



The resulting statistics of the subtracted LF are impres- 
sive, despite the restricted source selection. We proceed 
with a description of the major characteristics of the LF. 
The maximum corresponds to giants that lie on the upper 
part of the RGB. The decrease at fainter magnitudes is due 
to the selections applied to the data and to the decrease 



in sensitivity of the observations (Cioni et al. 2000a). Fea- 
tures like the horizontal branch or the red clump are too 
faint to be detected by DENIS. Towards brighter mag- 
nitudes we encounter a strong kink in the profile, which 
we associate with the position of the TRGB discontinuity. 
Brightward of the kink follows a bump of objects which 
we discuss below. At very bright magnitudes the LF has a 
weak tail which is composed of stars of luminosity type I 
and II (Frogel & Blanco |1983| ) , but the LF at these bright 
magnitudes could be influenced by small residuals due to 
inaccurate foreground subtraction. 

To explain the bump brightward of the TRGB discon- 
tinuity we cross-identified (Loup 2000] ) the DCMC sources 
with the sources in some of the Blanco fields in the LMC 
(Blanco 1980). In the (Ks, J — Ks) diagram there are two 



regions populated only by oxygen rich AGB stars (O— rich) 
and by carbon rich AGB stars (C-rich), respectively. O- 



Maria-Rosa L. Cioni et al.: The Tip of the Red Giant Branch and Distance of the Magellanic Clouds 



5 






1 II II II II 

: ^ 

I 


1 II II II 


3 ' 

-T- 1 1 I 1 I 1 I 1 


1 1 I I I 1 I 1 ri" 


10000 
5000 


-5000 
-10000 


-1 II II 1 II 


Milling 


1 I T I I I T I 1 


I T I I I T I I 1 


10000 
5000 


-5000 
-10000 


J_ l l l l l l l l 

: 4 


1 1 1 1 1 1 1 1 _L 


-\ 1 T 1 1 1 T 1 1 





Mill 


_ ; 

_^ - 


: s \ 

-t- 1 i i i i 










(m)N 



rap/(m)N i 



(ui)N 



rap/(ui)w P 



Fig. 3. Stellar magnitude distributions, N(m), and second derivative after the application of a Savitzky-Golay filter, 
d 2 N (m) I dm 2 , for the LMC (a-h) and the SMC (i-p). Panels (a-d) and (i-1) show the distributions for the main held 
(thin solid curve), for the scaled offset held (thin dashed curve), and for the foreground-subtracted main held (heavy 
solid curve). For the / and J bands we also show the distribution for the foreground-subtracted main field for the 
larger sample of all stars detected in / and J (irrespective of K$; heavy long-dashed curves). The final estimate of 
the TRGB discontinuity is indicated (vertical dotted line). The unit along the ordinate is the number of stars per 0.07 
mag bin. Panels (e-h) and (m-p) show the second derivative for the foreground-subtracted main field (heavy solid 
curve), the best Gaussian fit to the peak (thin solid curve), an d th e position of the peak (vertical dotted line). The 
solid rectangle in (b) outlines the region shown in detail in Fig. AT . 
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Fig. 4. Differential count of the number of sources de- 
tected versus magnitude in the area of the Magellanic 
Clouds after the subtraction of the foreground contribu- 
tion (thin solid line). This enlarges part of Figs. ||c and ||k. 
The curves show the contributions of O-rich AGB stars 
(dashed), C-rich TP- AGB stars (dotted), and spectro- 
scopically confirmed C-rich AGB stars (thick solid for the 
SMC only). 



rich stars are concentrated around Kg = 11.5 and have a 
constant color (J — Kg) = 1-2, and C-rich stars are con- 
centrated around (J — Kg) — 1.7 and around Kg = 10.5 
(see Fig. |b). These TP-AGB stars cause the bump vis- 
ible in the LF. This bump should not be confuse d wit h 
the AGB bump caused by E-AGB stars (Gallart |l99S|) . 
Fig. ^ shows an enlargement of Figs. ||c and ||k (contin- 
uous line). The dashed line refers to O-rich AGB stars 
and the dotted line to C-rich AGB stars selected in the 
(Kg, J— Kg) diagram. In the case of the SMC we selected 
regions with slightly bluer color and fainter magnitude to 
match the two groups of AGB stars in the (Kg, J — Kg) 
diagram, cf. Fig. |^d. Fig. |] also plots the LF (thick line) 
that results when we cross-identify our sample with the 
spectroscopically confirmed carbon stars by Rebeirot et 
al. ( |1983| ) in the SMC. We found 1451 sources out of 1707 
and we attribute the missing cross-identifications to the 
selection criteria that we applied to the DCMC data to 
obtain the sample for the present paper. It is interesting 
to note that at higher luminosities the distribution of the 
confirmed C-rich stars matches the distribution of C-rich 
stars selected only on the basis of Kg and (J — Kg). At 
the fainter luminosities C-rich AGB stars cannot be dis- 
criminated from O-rich AGB stars only on the basis of 
(J — Kg) and Kg because they overlap with the RGB, 
principally constituted by O-rich stars. 



4. The tip of the RGB 

4-1- Theory 

Theoretically stars climb the RGB with an expanding con- 
vective envelope and an hydrogen burning shell, while in- 
creasing the core-Helium content, the central tempera- 
ture, the central density, and the luminosity. Low-mass 
stars (O.8-1.OM < M < 2-2. 3M Q ) develop an electron- 



degenerate core, which causes an explosive start (Helium- 
flash) of the core Helium burning when the core mass 
reaches 0.45Mq, almost independently from the initial 
mass and composition of the star (Chiosi et al 
intermediate mass stars (2 — 2.3M < M < 8 - 



i992[ ); 

9M ) 

are not affected by degeneracy at this stage and initiate 
helium burning quietly, when a suitable temperature and 
density are reached. The RGB transition phase between 
the two behaviors occurs when the population is at least 
0.6 Gyr old and lasts roughly for 0.2 Gyr, determining 
an abrupt event in the population life time (Sweigart et 
al. 1990 ). The Helium-flash is followed by a sudden de- 
crease in the luminosity because of the expansion of the 
central region of the star and because of the extinction of 
the hydrogen-burning shell, the major nuclear energy sup- 
ply. The star reaches its maximum luminosity and radius 
(in the RGB phase) at the T RGB , which also marks the 
end of the phase itself (Iben 1967 ). Low-mass stars with 
the same metallicity accumulate along the RGB up to a 
TRGB luminosity of about 2500L Q (Westerlund |1997| ); 
the resulting RGB is quite extended. Stars with masses 
just above the transition mass (which discriminates be- 
tween low and intermediate masses) have a TRGB lumi- 
nosity as low as 2OOL (Sweigart et al. 1989, 1990) and 
the RGB is almost non-existent. Both low and interme- 
diate mass stars that finish burning their Helium in the 
core evolve on the AGB phase. They are in the so called 
E-AGB when Helium is burning in a thick shell and in 
the so called TP-AGB when both the Hydrogen and the 
Helium shells are active. The luminosity increases because 
of the increase in mass of the degenerate carbon core. The 
AGB evolution is characterized by a strong mass loss pro- 
cess that ends the phase when the outer envelope is com- 
pletely lost. The maximum AGB luminosity defines the 
tip of the AGB (TAGB), with core mass M c orc = 1.4M 



and magnitude Mboi = — 7.1 mag (Paczynski 1970 ) 



4-2. Detections 

In the observed diagrams (1,1 — J) and (Kg, J — Kg) 
the RGB is clearly visible (Fig. [5]). The beginning of the 
RGB phase is below the detection limits and the spread 
at the fainter magnitudes is due to the photometric er- 
rors. The TRGB is clearly defined at the brightest point 
of this branch as an outstanding roughly horizontal fea- 
ture. Dashed horizontal lines in the figure indicate the 
values of the TRGB discontinuity that we derive below 
for these data. The plume of objects brighter than the 
TRGB is composed of AGB stars experiencing the TP 
phase. From these diagrams the foreground contribution 
has not been subtracted but the contamination of these to 
the RGB/ AGB is negligible (Cioni et al. |l998| , p0Tj0a| ) if 
only the very central region of each cloud is selected; Fig. || 
contains sources with —67° > 5 > —69° toward the LMC 
and -72° > S > -74° toward the SMC. Stars populating 
the RGB up to the TRGB are low-mass stars older than 
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Fig. 5. Color-magnitude diagrams of (/,/ — J) on the 
left and (Ks,J — Ks) on the right for sources detected 
toward the LMC with -67° > S > -69° (panels a and b) 
and toward the SMC with -72° < S < -74° (panels c 
and d). A dashed horizontal line in each panel indicates 
the TRGB magnitude derived in Section 4 (Table |l|). 



Table 1. Summary of TRGB magnitude determinations 
and errors. Column (1): type of magnitude, i.e., either 
the photometric band or TOboi- Listed magnitudes for /, 
J and Ks are in the photometric system of the DE- 



NIS passbands (Fouque et al. |1999[ ). Column (2): Cloud 
name. Column (3): observed magnitude of the TRGB 
(not corrected for extinction), determined using the algo- 
rithm described in Appendix A. Column (4): magnitude 
of the TRGB corrected for extinction under the assump- 
tion that E(B — V) = 0.15. Column (5): formal error 
in totrgb derived from Monte-Carlo simulations as de- 
scribed in Appendix A. Column (6): the amount by which 
the extinction-corrected totrgb would change if the as- 
sumed E(B — V) were increased by +0.05 (a change of 
—0.05 yields the opposite change in ibtrgb)- 



Type 


Cloud 


"1TRGB 


"ITRGB 


Atotrgb 


<5dust 






(observed) 


(dereddened) 


(formal) 




(1) 


(2) 


(3) 


(4) 


1 (5) 


(6) 


/ 


LMC 


14.54 


14.27 


0.03 


-0.09 


/ 


SMC 


14.95 


14.68 


0.03 


-0.09 


J 


LMC 


13.17 


13.06 


0.02 


-0.04 


J 


SMC 


13.73 


13.62 


0.03 


-0.04 


K s 


LMC 


11.98 


11.94 


0.04 


-0.02 


K s 


SMC 


12.62 


12.58 


0.07 


-0.02 


rriboi 


LMC 




14.73 


0.04 


-0.03 


mboi 


SMC 




15.19 


0.03 


-0.03 



0.6 Gyr. TP-AGB stars on the other hand, which lie above 
the TRGB, can be either low-mass stars or intermediate 
mass-stars. For M(, j < —6 mag they all originat e from 
main-sequence stars with M < 3M (Westerlund 1997 ), 
which corresponds to a minimum age of 0.2 Gyr. TP-AGB 
stars that are low-mass stars should be older than 1 Gyr 



(Vassiliadis and Wood 1993). Note that the thickness of 
the RGB (~ 0.3 mag) is larger than the photometric er- 
rors involved (~ 0.1 mag) and this indicates a spread in 
either metallicity or extinction within each cloud. 

4.3. Method 

The algorithm that we have used for the determination 
of the position of the magnitude totrgb of the TRGB 
is described in great detail in Appendix A. The TRGB 
discontinuity causes a peak in both the first derivative 
N'(m) = dN(m)/dm and the second derivative N"(m) = 
d 2 N (to) /dm 2 of the observed stellar magnitude distribu- 
tion N(m). Previous authors have generally used N'(m) 
to estimate totrgb (e.g., Madore & Freedman 1995| ). 
Based on extensive tests and simulations we found that for 
our dataset N"(m) provides a better handle on totrgb 
(cf. Appendix A.l). We therefore adopted the following 
appro ach. F irst, we use a Savitzky-Golay filter (e.g., Press 
et al. 1992 ) to estimate TV" (to). We then search for a 
peak in TV" (to), and fit a Gaussian to it to obtain the 



quantities mi g and a^g that are the mean and disper- 
sion of the best-fitting Gaussian, respectively. The magni- 
tude totrgb is then estimated as TO2 + Ato 2 (ct2o), where 
ATO2 g ((T2 ff ) is a small correction (Fig. |A.2| b) derived from 
a phenomenological model described in Section A.l. The 
formal errors on the to-trgb determinations are inferred 
from extensive Monte-Carlo simulations, as described in 
Section A. 2. The possible influence of systematic errors 
is discussed in Section A. 3. There is no evidence for any 
possible systematic errors due to possible incompleteness 
in the sample, or inaccuracies in the foreground subtrac- 
tion. Systematic errors due to uncertainties in the phe- 
nomenological model on which the corrections Am2 g {o~2g) 
are based can be up to ±0.02 magnitudes. Extinction vari- 
ations within the Clouds do not cause systematic errors 
in either the estimate of totrgb or its formal error. How- 
ever, any error in the assumed average extinction for the 
sample does obviously translate directly into an error in 

n-TRGB ■ 

Fig. U summarizes the results of the analysis. The sec- 
ond and fourth row of the panels show the estimates of 
TV" (to). The Gaussian fit to the peak is overplotted, and 
its center m,2 g is indicated by a vertical dotted line. The 
corresponding estimate totrgb is indicated by a vertical 
dotted line in the panel for N(m). Table [l] lists the re- 
sults. It includes both the observed value for totrgb, as 
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well as the value obtained after correction for extinction 
with E(B — V) = 0.15. Formal errors are listed as well, 
and are typically 0.03-0.04 magnitudes. The last column 
of the Table lists the amount by which the extinction- 
corrected jbtrgb would change if the assumed E(B — V) 
were increased by +0.05 (a shift of —0.05 in the assumed 
E(B — V) would produce the opposite shift in totrgb)- 

When applying comparable methods t o reso lvable 
galaxies in the Local Group (e.g., Soria et al 199E; Sakai 



tween Mtrgb (K) and the metallicity in galactic globular 
clusters. For metallicities in the range of the Magellanic 
Clouds the variation of A1trgb(-£0 is about 0.2 mag; how- 
ever, this relation might not be valid for intermediate age 
populations. From the theoretical isochrones by Girardi 



et al. 1996 ) one of the major sources of contamination 
on the TRGB determination is the presence of a rela- 
tive strong AGB population. The Magellanic Clouds also 
have a strong AGB population, but in our case this does 
not confuse the determination of totrgb- This is due to 
the large statistics available, and above all to the fact 
that TP-AGB stars are definitely more luminous than 
the TRGB. E-AGB stars overlap with the RGB stars but 
there is no reason to assume, according to models, that 
they accumulate at the TRGB. Probably they distribute 
rather constantly and due to the very short evolutionary 
time scale we do not expect them to exceed more than 
10% of the RGB population. 

4-4- Discussion 

The absolute magnitude of the TRGB generally depends 
on the metallicity and the age of the stellar population 
and therefore need not to be the same for the LMC and 
the SMC. Nonetheless, if we assume that such differ- 
ences in TRGB absolute magnitude are small or negli- 
gible, and if we assume that the extinction towards the 
LMC and the SMC have been correctly estimated, then 
one may subtract for each photometric band the inferred 
ttitrgb(LMC) from the inferred totrgb (SMC) to obtain 
an estimate of the difference A = (to — M)smC — (to — 
M)i i mc between the distance moduli of the SMC and 
the LMC. This yields the following results: 0.41 ± 0.04 
(I band), 0.56 ± 0.04 (J band), 0.64 ± 0.08 (K s band) 
and 0.46 ± 0.05 (TOboi)- The dispersion among these four 
numbers is 0.09, which is somewhat larger than the for- 
mal errors. Averaging the four determinations yields A = 
0.52±0.04, where the error is the formal error in the mean. 
This is not inconsistent with determinations found in the 
literature, w hich g enerally fall in the range A = 0.4 — 0.5 
(Westerlund |l997| ). 

Upon taking a closer look at the values of A for the 
different bands one sees that the values in J and Ks ex- 
ceed those in / by 0.15 mag or more. It is quite possible 
that this is due to differences in the metallicity and age 
of the LMC and the SMC, which affect the TRGB ab- 
solute magnitude Mtrgb differently in different bands. 
In the / band -Mtrgb is reasonably insensitive to metal- 



et al. (2000) the spread of Mtrgb(-?0 is about 0.3 mag 
for ages greater than 2 Gyr and constant metallicity. This 
spread is somewhat less for the J band but it remains 
higher than the one derived for the I band. The fact that 
Mtrgb is modestly sensitive to variations in metallicity 
and age for the J and K bands implies that the values of 
A derived in these bands may not be unbiased estimates of 
the true difference in distance modulus between the SMC 
and the LMC. The / band value should be better in this 
respect, but on the other hand, that value is more sensi- 
tive to possible differences in the dust extinction between 
the Clouds. So the best estimate of A is probably obtained 
using mboi, as discussed further in Section 5. 

For the LMC there are several observed TRGB mag- 
nitude determinations in the literature that can be 
compared to our results. Reid et al. (1987) obtained 
totrgb(^) = 14.53±0.05, after extinction-correction with 
an assumed Aj — 0.07. Romaniello et al. (1999) ob- 
tained totrgb (I) = 14.50 ± 0.25 for the field around 
SN1987A. They corrected each star individually for ex- 
tinction, but found a mode of E(B — V) = 0.20 for their 



licity and age. Lee et al. (1993) showed that Mtrgb(-0 
changes by less than 0.1 mag for —2.2 < [Fe/H] < —0.7 
dex and for age s betw een 2 and 17 Gyr. For the K band, 
Ferraro et al. ( 1999 ) derived an empirical relation be- 



sample (corresponding to Aj = 0.30). Sakai et al. (1999) 
obtained totrgb (I) = 14.54 ± 0.04. They also corrected 
each star individually for extinction, but restricted their 
sample to low-extinction regions with Ay < 0.2 (corre- 
sponding to Ai < 0.10). The observed value of totrgb (-0 
for our sample, 14.54 ± 0.03, is nicely consistent with all 
these determinations. However, when we apply an extinc- 
tion correction of Ai = 0.27, as appropriate for an as- 
sumed E(B — V) = 0.15 (Section 2.3), our corrected value 
falls significantly below the previous determinations. This 
may mean that our assumed extinction is an overesti- 
mate. Support from this comes from a recent study by 
Zaritsky ( 1999 ). He demonstrates that the average extinc- 
tion towards cool stars is much lower than for the hotter 
stars which have typically been used to estimate the ex- 
tinction towards the LMC (the latter generally reside in 
star-forming regions which are more dusty, among other 
things). The analysis of Zaritsky (cf. his Fig. 12) suggests 
that the mode of the distribution of Ay for stars with tem- 
peratures appropriate for the RGB is as low as Ay « 0.1 
(corresponding to Aj ss 0.05), but with a long tail to- 
wards higher extinctions. Either way, it is clear that any 
proper interpretation of the TRGB magnitude in the / 
band requires an accurate understanding of the effects of 
dust extinction. We have not (yet) performed such an ex- 
tinction analysis for our sample, and therefore refrain from 
drawing conclusions from our I band results. However, our 
results are not inconsistent with observations by previous 
authors, provided that the extinction is actually as low as 
suggested by Zaritsky. 
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Fig. 6. The LMC Ks band magnitude distribution in 0.2 
magnitude bins. The dashed curve is for the DENIS data 
discussed in the present paper. The solid curve is the 
histogram obtained from 2MASS data and presented by 
Nikolaev & Weinberg ( [2000 ). The abscissa is the Ks mag- 
nitude in the DENIS photometric system. The 2MASS 
Kg magnitudes were transformed using Ks (DENIS) = 
Xs(2MASS) — 0.11, which was chosen so as to provide the 
best agreement between the two histograms. The scale 
along the ordinate is in arbitrary units. 



The best way to circumvent any dependence of the 
results on uncertainties in the dust extinction is to go 
far into the near IR. There is one very recent determina- 
tion of witrgb in the Ks band that can be compared to 
our results. Nikolaev & Weinberg ( 2000| ) used data from 
the 2MASS survey to derive totrgb(^s) = 12.3 ± 0.1 
for the LMC, without correcting for extinction. For a 
proper comparison of this value to our results we must 
correct for possible differences in the photometric magni- 
tude systems used by 2MASS and DENIS. Neither sys- 
tem is identical to the standard CTIO K magnitude sys- 
tem, but both are quite close. Nikolaev & Weinberg quote 
that their Ks magnitude system agrees with the stan- 
dard K to within 0.05 mag. For the DENIS system the 
final transformation equations will not be available un- 
til the survey is completed, but the analysis of Fouque et 
al. ( 1999Q yields an absolute flux zero-point (in Jy) for 
the DENIS K s system that differs from the CTIO K- 
band by 0.08 mag. Based on this, we do not expect the 
K s magnitudes of 2MASS and DENIS to differ by much 
more than 0.1 magnitudes. To determine the actual dif- 
ference, we compare in Fig. || our LMC Ks histogram 
to that presented by Nikolaev & Weinberg (using iden- 
tical binning). The 2MASS histogram was shifted hori- 
zontally to obtain the best agreement. From this we ob- 
tain if s (DENIS) = iY S (2MASS) - 0.11 ± 0.02. With this 
photometric correction the histograms are in good agree- 
ment. The slight differences at Ks < 11 magnitudes are 



probably due to differences in foreground subtraction. At 
faint magnitudes the DENIS data become incomplete at 
brighter magnitudes than the 2MASS data. However, tests 
discussed in Appendices A. 3. 2 and A. 3. 3 show that our 
determinations of vtitrgb are not influenced significantly 
either by possible incompleteness near the TRGB or by 
possible uncertainties in the foreground subtraction. Upon 
correction of the Nikolaev & Weinberg jtitrgb determi- 
nation to the DENIS Ks magnitude system one obtains 
wtrgb(-Ks) = 12.19 ± 0.1. Somewhat surprisingly, this 
exceeds our determination mxRGB(^s) = 11.98±0.04 by 
as much as 0.21 magnitudes. Given that the histograms 
themselves are in good agreement (Fig ^), we are forced 
to conclude that this must be due to differences in how 
to trgb is defined and determined. While we search for a 
peak in N"(m) and then add a correction term that is 
based on a model, Nikolaev & Weinberg just determine 
the peak in the first der ivative N'(m). As discussed in 
Section A.l (see Fig. A. 2) this generally yields on overes- 
timate of the actual TRGB magnitude. Since Nikolaev & 
Weinberg do not describe their analysis technique in de- 
tail, it is difficult to estimate the size of this bias in their 
result. However, Monte-Carlo simulations that we discuss 
in Section A. 4 indicate that it could be ~ 0.15 ± 0.06, 
which would explain the observed discrepancy. Note that 
the same effect may also affect some of the I band com- 
parisons listed above, although for those the influence of 
extinction probably plays the more significant role. 

5. Distance to the Magellanic Clouds 

To estimate the distance modulus of the Magellanic 
Clouds we can use the observed magnitude of the TRGB in 
either 7, J, Ks or mboi- As discussed in Section 4.4, I has 
the disadvantage of being sensitive to uncertain extinc- 
tion corrections, while J and Ks have the disadvantage 
of being sensitive to the assumed metallicity and age. The 
most accurate information on the distance is therefore pro- 
vided by TYiboi j which is not particularly sensitive to either 
dust extinction (cf. Table or metallicity and age. To 
quantify the latter we use the stellar evolutionary model 
calculations of Salaris & Cassisi ( 1998 ). They quantified 
the dependence of -Mtrgb (bol) on the total metallicity 
{[M/H]) of a population, and found that 

M TRG B(bol) = -3.949 - 0.178[M/if] + 0.008[M/i/] 2 , (1) 

valid for —2.35 < [M/H] < —0.28 and for ages larger than 
a few Gyr. 

We determined [M/H] by qualitatively fitting 
isochrones (Girardi et al. 2000] ) to the color-magnitude 
diagram (K Sl J - K s ). We obtain Z = 0.004 ± 0.002 for 
the LMC, in agreement with the value derived by Niko- 
laev & Weinberg, and Z = 0.003 ± 0.001 for the SMC. 
For Z Q = 0.02 this corresponds to [M/H] = -0.70 and 
[M/H] = -0.82 for the LMC and the SMC, respectively. 
This in turn yields -Mtrgb (bol) = -3.82 for the LMC 
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and M TR GB(bol) = -3.80 for the SMC. When combined 
with the results in Table [l] we obtain for the LMC that 
(m-M) = 18.55 ±0.04 (formal) ±0.08 (systematic), and 
for the SMC that (m — M) — 18.99 ± 0.03 (formal) ±0.08 
(systematic). The corresponding distances are 51 and 63 
kpc to the LMC and the SMC respectively. 

The systematic errors that we quote in our results are 
the sum in quadrature of the following possible (identi- 
fied) sources of error: (i) ±0.02 mag due to uncertainties 
in the phenomenological model on which the corrections 
Am 2g (cr2g) are based (cf. Section A. 3.1); (ii) ±0.03 mag 
to account for the fact that our assumed average dust ex- 
tinction of E(B — V) = 0.15 could plausibly be in error 
by 0.05 (cf. Table 0); (iii) ±0.04 mag, reflecting the un- 
certainties in Mtrgb (bol) due to uncertainties in [M/H] ; 
(iv) ±0.04 mag, reflecting the uncertainty in Mtrgb (bol) 
at fixed [M/H] suggested by comparison of the predic- 
tionsof different stellar evolution models (Salaris & Cas- 
sisi 1998 ; their Fig. 1); (v) ±0.05 mag, being an estimate 



of the possible systematic error in our calculation of bolo- 
metric magnitudes due to uncertainties in the underlying 
spectral model (see Section 2.2). 

There have been many previous determinations of the 
distance modulus of the LMC, and these have varied 
widely, from about 18.0 to 18.7. Based on a collection of 
many determinations, the HST Key Pro ject T eam adopted 
(m - M) = 18.50 ± 0.13 (Mould et al. |2000p . Our deter- 
mination is in excellent agreement with this value, and 
actually has a smaller error. The TRGB method itself has 
been used previously by several other authors to study the 
distance modulus of the LMC, and our results are consis- 



tent with all of these. Reid, Mould & Thompson ( pL987| ) 
were the first to apply this technique to the LMC (by 
studying the Shapley Constellation III using photographic 
plates), and obtained (m — M) = 18.42±0.15. Romaniello 
et al. ( P-999D obtained (m-M) = 18.69 ±0.25 from a field 
around SN1987A in the LMC using HST/WFPC2 data. 
Sakai et al. (199E) obtained 18.59 ± 0.09 from an area 
of 4 x 2.7 square degrees (north of the LMC bar) stud- 
ied as part of the Magellanic Cloud Photometric Survey 
(Zaritsky, Harris & Thompson 1997) using the Las Cam- 
panas lm telescope. Nikolaev & Weinberg ( 2000) obtained 
(m - M) = 18.50 ± 0.12 from the subset of 2MASS data 
that covers the LMC. For the SMC we are not aware of 
(recent) TRGB distance modulus measurements, but our 
result is consistent with the value (m — M) = 18.90 ±0.10 



quoted by Westerlund ( 1997 ) from a combination of mea- 
surements available in the literature from a variety of tech- 
niques. 

6. Conclusions 

We have determined the position of the TRGB for both 
Magellanic Clouds using the large statis tical sample of- 
fered by the DCMC (Cioni et al. |2000a|) . We have pre- 
sented a new algorithm for the determination of the TRGB 



magnitude, which we describe in detail in the Appendix 
and test extensively using Monte-Carlo simulations. We 
note that any method that searches for a peak in the first 
derivative (used by most authors) or the second derivative 
(used by us) of the observed luminosity function does not 
yield an unbiased estimate for the actual magnitude of the 
TRGB discontinuity. We stress the importance of correct- 
ing for this bias, which is not generally done. Our analy- 
sis shows that when large enough statistics are available, 
contamination by AGB stars does not provide a signifi- 
cant limitation to the accuracy of the TRGB magnitude 
determination. 

In our analysis we have adopted global values for the 
extinction of the Magellanic Clouds and we have derived 
the metallicity from an isochrone fit to the giant popula- 
tion to obtain a representative value for each cloud as a 
whole. In reality, extinction and metallicity are likely to 
vary within each cloud. Clearly, the production of a de- 
tailed extinction map together with precise measurements 
of the metallicity is a requirement for a detailed analy- 
sis of variations in structure between different locations 
within the Clouds, either on the plane of the sky or along 
the line of sight. However, such variations do not influence 
our distance determinations, which should be accurate in a 
globally averaged sense. Uncertainties in the average dust 
extinction or metallicity for each cloud are included in the 
systematic error budget of our final estimates. 

We combine our apparent bolometric TRGB magni- 
tude determinations with theoretical predictions to derive 
the distance modulus of the Clouds. We obtain (m — M) = 
18.55 ± 0.04 (formal) ±0.08 (systematic) for the Large 
Magellanic Cloud (LMC), and (m-M) = 18.99±0.03 (for- 
mal) ±0.08 (systematic) for the Small Magellanic Cloud 
(SMC). These results are consistent with many previ- 
ous studies, including a recent compilation by Mould et 
al. ( |2000] ). However, only very few previous studies have 
yielded determinations of similar accuracy as those pre- 
sented here. This re-confirms the TRGB method to be 
a high quality method for distance determination of re- 
solved stellar populations, and stresses the power of large 
statistical samples in the NIR such as those provided by 
the DENIS survey. 

Appendix A: Determination of the TRGB 

magnitude: methodology and error 
analysis 

A.l. The nature of the TRGB discontinuity 

We wish to determine the magnitude ttitrgb of the TRGB 
discontinuity from an observed magnitude distribution 
/obs(m). In general, the observed distribution will be the 
convolution of the intrinsic magnitude distribution of the 
stars, /i n t(TO), with some broadening function E(m): 



/obs(ra) 



hnt{m')E(m - m') dm'. 



(A.l) 
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The function E(m) characterizes the probability that a 
star with magnitude too is observed to have magnitude 
m b s = too + m- The shape of E(m) is generally deter- 
mined by the properties of the observational errors, but 
other effects (such as differences in extinction or distance 
among the stars in the sample) can contribute as well. 

To gain an understanding of the issues involved in the 
determination of totrgb we start by considering a simple 
model. We assume that E{m) is a Gaussian of dispersion 
a: 



E(m) = 



1 



27T(7 



(A.2) 



We approximate fi n t(m) by expanding it into a first-order 
Taylor expansion near the position of the discontinuity, 
which yields 

r / s _ f fo + ai(m - m TRGB ), if to < to T rgb 

mt \ fo + A/ + a 2 (m - totrgb), if to > to T rgb 

The parameters a\ and ai measure the slope of /i n t for 
magnitudes that are brighter and fainter than totrgb, 
respectively. At brighter magnitudes the sample is dom- 
inated by AGB stars, while at fainter magnitudes both 
AGB and RGB stars contribute. The parameter A/ mea- 
sures the size of the discontinuity; the ratio A/// is an 
estimate of the ratio of the number of RGB to AGB stars 
at the magnitude of the RGB tip. 

1) to 



We fitted the model defined by Eqs. flA.lp - 
the observed (foreground-subtracted) J band magnitude 
histogram for the LMC, which is shown as a connected 
heavy dashed curve in Fig. |A.l| a. The heavy solid curve 
shows the model distribution / Q b s that provides the best 
fit. The fit is acceptable. The parameters for this model 
are: f = 0.091, Af = 0.250 (both in units in which the 
normalization of / is arbitrary), a\ = —0.108, a 2 = 0.928, 
mTRGB = 13.16 and a = 0.126. The long-dashed curve 
shows the underlying distribution /int (to) for this model. 
For these J band data we know that the magnitude er- 
rors are dominated by photometric zero-point variations 
between the scan-s trips that constitute the LMC sample 
(Cioni et al. 2000a ). These variations have a dispersion of 
0.13 (which significantly exceeds the formal photometric 
errors near the TRGB magnitude, cf. Fig. Q). In view of 
this, the value a = 0.126 inferred from the model fit is 
very reasonable. 

Model fitting can be used as a general tool to estimate 
wtrgb from an observed magnitude distribution. How- 
ever, this technique is error-prone, since one is essentially 
solving a deconvolution problem in which neither the ex- 
act shape of the intrinsic magnitude distribution /int (to) 
nor that of the kernel E(m) is well known a priori. A 
more robust approach is to locate a feature in the ob- 
served distribution / bs(w) that is a direct consequence 
of the discontinuity at totrgb • Since a discontinuity cor- 
responds (by definition) to an infinitely steep gradient, 
one obvious approach is to search for a maximum in the 
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Fig. A.l. (a) The connected heavy dashed curve shows 
the foreground-subtracted LMC J band magnitude distri- 
bution (thus providing an expanded view of the region in- 
dicated by a rectangle in the LMC J band panel in Fig. |3|) 
for the expanded sample of stars detected in the / and J 
bands (irrespective of whether or not they were detected 
in Kg). This sample is complete over the displayed magni- 
tude range. The heavy solid curve shows the distribution 
predicted by the model described in the text. This model 
has the intrinsic distribution /; nt (to) shown as a thin long- 
dashed curve, and has an observational convolution ker- 
nel E(m) that is a Gaussian with a dispersion a = 0.126. 
For comparison, thin dotted curves show the predictions 
obtained when the same intrinsic distribution f- m t{m) is 
convolved with Gaussians of size a of 0.05, 0.10, 0.15 and 
0.20, respectively, (b) The first derivative of the functions 
shown in panel (a), (c) The second derivative of the func- 
tions shown in panel (a). Note that the discontinuity at 
the TRGB induces a peak in both the first and the second 
derivative. 
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first derivative f^ hs = d/ b s /dm. This approach has been 
used in several previous studies of TRGB magnitude de- 



terminations (e.g., Lee, Freedman & Madore 1993). For a 
model with a\ = 0,2 = a one can show that one expects 
simply f' ohs {m) = a + AfE(m - m TRG B), i.e., the first 
derivative is a Gaussian centered at totrgb plus a con- 
stant. However, the above analysis shows that a\ 7^ 02- 
So while the derivative f' ohs generally does have a maxi- 
mum near totrgb, the structure of the first derivative is 
generally mo re co mplicated than a Gaussian. The heavy 
curve in Fig. A. l b shows f'^Jjn) f° r ^ ne m odel with the 
parameters determined from the J band data. 

The magnitude distribution of stars on the AGB is 
very different from that on the RGB. While the for- 
mer is approximately constant and in fact even slightly 
increasing to brighter magnitudes (a% < 0), the latter 
increases very sharply to fainter magnitudes (02 > 0). 
Hence, not only f- lnt , but also its derivative is discontin- 
uous at totrgb- This corresponds to an infinitely steep 
gradient in the first derivative (see the long dashed curves 
in Fig. A.l), which can be identified by searching for 
a maximum in f" b = d 2 / b s /dm 2 . For a model with 
A/ = one can show that one expects simply that 
/obs( TO ) = ( a 2~ ai)E(m — totrgb), i-e., the second deriva- 
tive is a Gaussian centered at totrgb- While the above 
discussion shows that the best fit to the data is obtained 
for A/ 0, the value of A/ is close enough to zero to en- 
sure that /obs( m ) I s always modestly well approximated 
by a Gaussian (especially near its peak). Fig. |A.l| c shows 
/"bs f° r the model with the parameters determined from 
the J band data. 

While the discontinuity in /i nt causes both a maxi- 
mum in /^ bs at a position TOi and a maximum in /" bs 
at a position TO2 , it is important to realize t hat neither 
provides a unbiased estimate of Totrgb- Fig. A2a shows 
for the model derived from the J band data the differ- 
ences Ami = toi — totrgb and Ato-2 = TO2 — totrgb as 
function of a. In absolute value, the differences increase 
monotonically with a. The value of mi always provides 
an overestimate of totrgb while TO2 always provides an 
underestimate. It is important to realize that in practice, 
because of finite statistics, one must always apply a certain 
amount of smoothing to real data to obtain an adequate 
estimate of either /^ bs or f" hfj . This smoothing usually 
takes the form of binning (e.g., Lee, Freedman & Madore 
1993| )) or kernel smoothing (e.g., Sakai, Madore & Freed- 



man Il996). When assessing the size of the bias terms in 
Fig. A. 2a for any particular application, the value of a 
along the abscissa should therefore not be taken merely 
as the average photometric error for the data, but should 
include the effect of the additional smoothing that was 
applied to obtain the estimate of either toi or TO2. While 
photometric errors of a few hundredths of a magnitude 
are often routinely achieved, the additional smoothing or 
binning applied during data processing i s oft en as large as 
0.1 to 0.2 magnitudes. According to Fig. A2a, this can in- 
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Fig. A. 2. (a) The differences Atoi = mi — totrgb and 
Ato2 = to 2 — totrgb as function of a, for models with the 



intrinsic magnitude distribution shown in Fig. A.l. The 
quantities toi and TO2 are, respectively, the magnitudes at 
which the first and second derivatives of the observed mag- 
nitude distribution have their peak, while Totrgb is the 
magnitude of the actual TRGB discontinuity. The quan- 
tity a is the dispersion of the observational convolution 
kernel E(m). (b) The difference ATO2 ff = TO2 ff — totrgb 
as function of U2 g , where m^g and a^g are the mean 
and dispersion of the Gaussian that best fits the peak 
in f" hs {m). The solid curve refers to the same models as 
in (a), and provides the correction term that we have ap- 
plied to the observed TO2 ff to obtain estimates of totrgb- 
The other curves are for models with A/ = 0.18 (dashed) 
and A/ = 0.38 (long-dashed) in Eq. A. 3; as discussed in 
Section A.3.1, the differences between these curves and 
the solid curve provide an estimate of possible systematic 
errors in our results due to uncertainties in the adopted 
model for /i n t(m). 



duce systematic biases in the estimate of totrgb that are 
of the same order. So while this is not typically done (e.g., 



Saka i, Zaritsky & Kennicutt 1999; Nikolaev & Weinberg 
[2000 ), we do believe that such systematic biases should be 
calculated and corrected for. 
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Previous authors have generally searched for the mag- 
nitude of the TRGB by determining the position of the 
peak in f^ hs . As far as we know, no one has yet used 
fobs- This is presumably for the obvious reason that it 
is more difficult to determine the second derivative from 
noisy data than the first derivative. However, the situation 
for the DCMC catalogue differs considerably from that for 
most other studies. First, we have a very large number of 
stars, so that it is actually not a problem to accurately 
determine /" bs . Second, the random errors in the sample 
are relatively large. This is not because of photometric 
errors (which are small, cf. Fig. but because of photo- 
metric zero-point variations between the scan-strips that 
constitute the sample. The effect of the size of the errors 
on the properties of f^ ha and /" bs are illustrated by the 



dotted curves in Fig. A..1, which show predictions for the 
same model as before, but for values of a of 0.05, 0.10, 
0.15 and 0.20, respectively. We have found that the values 
of a appropriate for our analysis are such that the peak in 
/obs( TO ) i s generally not the most easily recognizable fea- 
ture in the data. After extensive testing we concluded that 
for our data /"b s ( m ) provides a better handle on totrgb 
than does f' ODS {m). 

In practice, we estimate the properties of the peak in 
/obs( TO ) hy performing a Gaussian fit. This yields to,2 S , the 
center of the best-fitting Gaussian, and o~2 g , the dispersion 
of the best-fitting Gaussian (in general, the value of 02 g is 
roughly of the same order as a, and Ato,2 S is roughly of the 
same order as A7712). For given f- lnt , both m<i g and <72g are 
unique monotonic functions of er. So one can view Arri2g = 
Tti2g — wtrgb to be a function of <t 25 . The solid curve in 
Fig. A. 2b shows this function for the /j nt parameterization 



derived from the J band data. 



A. 2. Implementation and formal errors 

To implement our strategy we bin the observed stellar 
magnitudes for the region of the sky of interest into a 
histogram, using a fixed bin size b. As described in Sec- 
tion 3.1, we do the same for observations of an offset field, 
and subtract an appropriately scaled version of the offset 
field histogram from the main field histogram to obtain a 
foreground-subtracted histogram N(m) . We then apply a 
Savitzky-Golay filter (e.g., Press et al. 1992 ) to estimate 
the second derivative d 2 N(m) /dm 2 at the position of each 
bin. This yields for bin number i 



[d 2 N/dr 



j 

£< 

j=-j 



Mm)] 



(A.4) 



where the Cj are Savitzky-Golay coefficients for the chosen 
value of J and the desired derivative order L = 2. The fil- 
ter fits a polynomial of order M to the data points [N(m)]j 
with j — i — J, . . . ,i + J, and then evaluates the L th deriva- 
tive of the polynomial at bin i to estimate [d 2 iV/dm 2 ]i. 
Once a histogram approximation to [d 2 -/V/dm 2 ] has been 



calculated, we search for a peak and fit a Gaussian in the 
region around the peak to obtain rri2g and a2 g (the mean 
and dispersion of the best-fitting Gaussian). From these 
values we estimate the magnitude totrgb as 



totrgb = rn 2g - Am 2 g(a2g), 



(A.5) 



where the correction term Am2 g {o r 2g) is taken from 



Fig. A. 2b. To summarize, totrgb is estimated as the posi- 



tion where the second derivative of the observed histogram 
has its maximum, plus a small correction that is based on 
a model for the underlying magnitude distribution /i nt . 

We performed extensive Monte-Carlo simulations to 
assess the accuracy of the totrgb estimates produced by 
this algorithm. In these simulations Cloud stars are drawn 
from the magnitude distribution /i nt given by Eq. ( A. 3 ), 
using as before the parameters determined from the J 
band data. Foreground stars are drawn from a smooth 
magnitude distribution that matches that inferred from 
our data, both for the main field and a hypothetical offset 
field. To each stellar magnitude an error is added that is 
drawn from a Gaussian with dispersion a. The numbers 
of stars in the simulations were chosen to match those 
in our datasets. In each simulation, the magnitudes thus 
generated are analyzed in exactly the same way as the 
real data to obtain m2 g and <J2 9 , and from these (using 
Eq. A.5) an estimate totrgb ■ This procedure is then re- 
peated many times in Monte-Carlo fashion, and for the 
resulting ensemble we calculated the mean (totrgb) and 
dispersion ct to ,trgb of the totrgb estimates, as well as 
the mean (o~2 g ) of the o~2g- In the simulations we exper- 
imented with the choice of the algorithm parameters 6, 
J, and M. We found that accurate results were obtained 
with, e.g., J = 3, M = 2 and a binsize b = 0.07 magni- 
tudes. These parameters were therefore generally adopted 
for the further analysis (with the exception of the SMC 
Ks band data, for which we used the slightly larger bin 
size b = 0.10 magnitudes). The Savitzky-Golay coeffi- 
cients for this choice of parameters are Cj — Cj/b 2 , with 
c = -0.0476, ci = c_i = -0.0357, c 2 = c_ 2 = 0, 
C3 = c_3 = 0.0595. With these parameters we found that 
I (totrgb) — totrgb I < 0.01 magnitudes, independent of 
the assumed a. Hence, the algorithm produces unbiased 
estimates of totrgb • This result was found to be rather in- 
sensitive to the precise choice of the algorithm parameters; 
different parameters generally yielded similar results for 
totrgb- The formal error on a determination of totrgb 
from real data is obtained as follows: (i) we run simula- 
tions with the appropriate numbers of stars, for a range 
of <7 values; (ii) we identify the value of a that yields a 
value of (o~2 g ) that equals the value of <7 2g inferred from 
the data; (iii) the corresponding value of <7m,TRGB is the 
formal error that was sought. The errors thus inferred are 
listed in Table [jj typical values are 0.02-0.05 magnitudes. 
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A. 3. Assessment of systematic errors 

The Monte-Carlo simulations provide accurate estimates 
of the formal errors in the totrgb determinations due to 
the combined effects of the finite number of stars and the 
properties of our adopted algorithm. However, they pro- 
vide no insight into possible systematic errors. We have 
performed a number of additional tests to assess the in- 
fluence of possible sources of systematic errors. 

A. 3.1. Accuracy of the correction term Arri2g 



Our estimates for totrgb are obtained from Eq. (A.5), 
in which we add to the observed magnitude m,2g of the 
/obs( TO ) peak a correction Ar/i2 S that is derived from a 
model. Any error in the model will change the correction 
Am,2 g , which in turn yields a systematic error in the de- 
rived wtrgb- It is therefore important to understand the 
accuracy of the model. 

There are two main parameters in fitting the model 
defined by Eqs. (A.1)-(A.3) to an observed histogram, 
namely the 'step-size' A/ of the function /i n t(m), and 
the dispersion a of the convolution kernel E(m). These 
parameters are highly correlated. If (as compared to the 
best fit model) Af is increased, then an appropriate si- 
multaneous increase in a will yield a predicted profile 
/obs(w) that is only slightly altered. From experiments 
with our Monte-Carlo simulations we conclude that for 
all 0.18 < A/ < 0.38 one can still obtain an acceptable fit 
to the observed J band magnitude histogram. At the lower 
end of this range we require a = 0.105 and at the high end 
a = 0.169, neither of which seems entirely imp laus ible for 
the J band data. The dashed curves in Fig. ASb show 
the correction factors Ani2g(o-2g) for these models. These 
can be compared to the solid curve, which pertains to the 
model with A/ = 0.25 shown in Fig. A.l. A typical value 
of a2 g for our data is ~ 0.11. Fig. A. 2b shows that for this 
CT2 9 the systematic error in Am.2 g (and hence totrgb) due 
to uncertainties in A/ is approximately 0.02 magnitudes. 

The correction term Am2g(o~2 g ) that we have applied 
to all our data was derived from LMC data in the J band. 
This would not be adequate if the shape of /i n t(m) differs 
significantly among the I, J and Ks bands, or among the 
LMC and the SMC. However, visual inspection of Fig. || 
does not strongly suggest that this is the case: the shape 
of the observed magnitude histograms near the TRGB is 
similar in all cases. Quantitative analysis supports this, 
and demonstrated that values of 0.18 < A/ < 0.38 are 
adequate for all our data. 

A. 3. 2. Incompleteness 

In our main sample we have only included stars that were 
confidently detected in all three photometric bands. Fig. [| 
shows that for this sample incompleteness starts to be an 
issue at brightnesses that are only a few tens of a magni- 



tude fainter than the inferred totrgb- One may wonder 
whether this could have had a systematic influence on the 
totrgb determinations. To assess this we applied our al- 
gorithm also to a different (extended) sample consisting 
of those stars that were detected in the I and J bands 
(irrespective of whether or not they were detected in Ks), 
which is complete to much fainter magnitudes than the 
main sample (heavy dashed curves in Fig. ||). The RMS 
difference between the totrgb estimates from the main 
and the extended sample (for those cases where both are 
available) was found to be 0.04, which can be attributed 
entirely to the formal errors in these estimates. We there- 
fore conclude that there is no evidence for systematic er- 
rors due to possible incompleteness. 

A. 3. 3. Foreground subtraction 

Our method for foreground subtraction (see Section 3.1) is 
based on an empirical scaling of the magnitude histogram 
for an offset field. To assess the effect of possible uncer- 
tainties in the foreground subtraction we have, as a test, 
done our analysis also without any foreground subtrac- 
tion (i.e., using the thin solid curves in the N(m) panels 
of Fig. |3|). Even this very extreme assumption was found 
to change the inferred totrgb values only at the level of 
~ 0.02, which can be attributed entirely to the formal er- 
rors in the estimates. We therefore conclude that there is 
no evidence for systematic errors due to uncertainties in 
the foreground subtraction. 

A. 3. 4. Extinction 

Extinction enters into our analysis in various ways. For 
the I, J and K$ data we have performed our analysis 
on data that were not corrected for extinction. Instead, 
we apply an average extinction correction to the inferred 
totrgb values after the analysis. Obviously, any error in 
the assumed average extinction for the sample translates 
directly into an error in totrgb- Table |l| lists for each 
band the shift in totrgb that would be introduced by a 
shift of +0.05 in the assumed E(B-V) (a shift of -0.05 in 
the assumed E(B — V) would produce the opposite shift in 
to-trgb)- It should be noted that our analysis does not as- 
sume that the extinction is constant over the region of sky 
under study. If there are variations in extinction then this 
causes an additional broadening of the convolution kernel 
E(m) beyond what is predicted by observational errors 
alone. The width of the convolution kernel is not assumed 
to be known in our analysis, but is calibrated indirectly 
through our determination of o~2g (the dispersion of the 
/obs( m ) P ea k)- Hence, any arbitrary amount of extinction 
variations within the Clouds will neither invalidate our 
results, nor increase the formal errors. 

In our calculation of the bolometric magnitudes TOboi of 
the individual stars in our sample from the observed J and 
Ks magnitudes we do correct for extinction. The effect of 
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a change in the assumed E(B — V) affects the inferred 
niTRGB values in a complicated way, because both the 
magnitudes and the colors of individual stars are affected. 
We therefore performed our entire analysis of the mt,oi 
histograms for three separate assumed values of E{B — 
V), namely 0.10, 0.15 and 0.20. From these analyses we 
conclude that an increase in E(B — V) of +0.05 decreases 
the inferred bolometric totrgb by —0.03 (a shift of —0.05 
in the assumed E(B — V) would produce the opposite 
shift in totrgb)- As for the /, J and K$ data, extinction 
variations within the Clouds will not invalidate the results 
or increase the formal errors. 

A. 4- Comparison to other methods 

Most authors have searched for the magnitude mi of the 
peak in the first derivative f^ hs to estimate the magnitude 
wtrgb of the TRGB discontinuity. While this is a per- 
fectly good approach, it is important to realize that this by 
itself does not yield an unbiased estimate of ttitrgb ■ This 
was pointed out previously by Madore & Freedman ( 1995 ; 
see their Fig. 3). However, they were not overly concerned 
with this, since their aim was to test the limitations on de- 
termining mTRGB to better than ±0.2 mag. As a result, it 
has not been common practice to estimate the bias Ami 
intrinsic to mi and correct for it. Fig, 
that for small values of a one has |Ami 



et al. (1999) use a bin size as large as 0.25 mag in their 
analysis, and their estimate of the TRGB magnitude is 
therefore likely to be biased upward even more. 

Our method differs from that employed by Sakai, 



A.2|a also shows 
Am 2 | 



< |Am 2 |, so 

the application of a correction may seem less important 
for methods based on the first derivative than for those 
based on the second derivative. On the other hand, it has 
now become possible to determine mi with formal errors 
of order 0.1 mag or less (e.g., Sakai, Zaritsky & Kenni- 
cutt 1999; Nikolaev & Weinberg 2000), so it is important 



to correct for systematic biases even if one uses the first 
derivative, as we will illustrate. 

To estimate quantitatively the size of possible biases in 
the results of previous authors one must do Monte-Carlo 
simulations for their exact observational setup and anal- 
ysis procedure, which is beyond the scope of the present 
paper. However, as an illustration i t is u seful to consider 
the result of Nikolaev & Weinberg ( 2000 ), who find from 
2MASS data for the LMC that m TRGB (K s ) = 12.3±0.1. 
This corresponds to ttitrgb i-K-s) = 12. 19 ±0.1 in the DE- 
NIS photometric system, which conflicts significantly with 
our result m T RGB(-fCs) = 11.98 ± 0.04 (see Section 4.4). 
Nikolaev & Weinberg derived their result from an analysis 
of the derivative of the observed magnitude distribution; 
the latter is shown and listed as a histogram with 0.2 
mag. bins in their Fig. 9 and Table 1. If they used the So- 
bel edge detection filter suggested by Madore & Freedman 
( |1995| ) on this histogram, then Monte-Carlo simulations 
that we have done (similar to those in Section A. 2) indi- 
cate that their estimate of mi could overestimate mxRGB 
by as much as ~ 0.15 ± 0.06. If we correct their result for 
this bias, then we obtain totrgb(^s) = 12.04 ± 0.12 for 
their data, in good agreement with our result. Romaniello 



Madore & Freedman (1996) in that they employ kernel 
smoothing and estimate f^ hs as a continuous function, 
while we employ histograms. Sakai et al. quote as an ad- 
vantage of their technique that it avoids the arbitrary 
choice of bin size and histogram starting point. While this 
is true, we have not found any evidence that this makes a 
significant quantitative difference. Our Monte-Carlo simu- 
lations indicate that our results obtained from histograms 
are unbiased to better than 0.01 mag., and we have found 
this to be true for all histogram starting points and a large 
range of reasonable bin sizes. However, we should point 
out that for this to be the case it is important to apply 
appropriate corrections for systematic biases (which ap- 
plies equally to histograms estimates and kernel smooth- 
ing estimates). 

A final issue worth mentioning is the estimation of the 
formal error in mTRGB ■ We have done this through Monte- 
Carlo simulations, which is probably the most robust way 
to do this. By contrast, Sakai, Zaritsky & Kennicutt ( 1999| ) 
quote as the formal error the FWHM of the observed peak 
in /o bs . It should be noted that this is not actually accurate 
(it is probably conservative). Recall from Section A.l that 
for the simplified case in which a\ — a 2 = a in Eq. (A.3), 
one has /obs( TO ) = a + AfE(m — ditrgb ) • Hence, the 
dispersion of the peak in f^ bs (rn) measures the random 
error in the individual stellar magnitude measurements 
(plus whatever smoothing was applied to the data). This 
dispersion is independent of the number of stars in the 
sample (N), and therefore cannot be a measure of the 
formal error in mxRCB- The true formal error (i.e., the 
dispersion among the results obtained from different ran- 
domly drawn samples) scales with the number of stars as 

i/Vn. 
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